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SUMMARY 


The method proposed by Hopfield and Tank for using the Hopfield neural network with 
continuous^ valued neurons to Live the traveling salesman problem (TSP) is tested by smrulatiom 

Several researchers have apparently been unable to successfully repeat t ' ,, 

documented by Hopfield and Tank. However, it appears that the reason for those difficulties 
a ^y Tarameter vie is reported erroneously (by four orders of magnitude) rn the original paper. 
When a reasonable value is used for that parameter, the network performs generally as cla med. 
Addffional^,°a^iew method of using feedback to control the input bias currents to the amplifiers 
is proposed and successfully tested. This eliminates the need to set the input currents by ria 


error. 


INTRODU CTION 


The neural network approach to computation is based on highly parallel, analog architecture 
The neural networks proposed by Hopfield and Tank would ultimately be constructed a. integrated 
packages of resistors, capacitors, and operational amplifiers. The operational amplifiers wh 
constitute the artificial “neurons," would be operated well beyond their linear ranges and into 
saturation. The potential applications are in pattern recognition, complex motion control, an 
other problems which have proven to be either too computationally intensive or simply not practical 
for conventional digital computers. Neural networks have the potential for rapidly solving some 
very difficult problems that require excessive amounts of time on digital computers. 

Hopfield and Tank (ref. 1) have shown that neural networks can be applied to certain op- 
limitation problems. In particular, they propose that neural networks may be usefid l ut : so g 
combinatorial optimisation problems very rapidly, provided that one does not require the ab olute 
optimal solution but only a reasonably good one. They show how to “map” a particular combmatce 
rial optimization problem, the traveling salesman problem (TSP), onto the network. e g 

saTesZTproblem may be stated as follows: given n city locations, plan a tour for a salesman such 
that each city is visited exactly once, with the salesman ultimately returning to the starting city, 
in the minimum possible distance. 

The mapping of the traveling salesman problem onto the neural network consists of the speci- 
fication of an energy function of, and a physical interpretation of, the output state of the network 
The network seekf.he minimum energy state, which is interpreted according to predetermined 
rules as a particular solution of the TSP. 


Hopfield Network 

In the most general configuration of the Hopfield neural network, the output of each operational 
amplifier (“neuron”) would be connected to the input of every other amplifier through some effective 
conductance, forming a matrix of conductances, or a “connection matrix . The input of each 
amplifier is also connected through a parallel RC network to ground. The input/output relationship 
of each operational amplifier approximates a sigmoid function (fig. 1). The gain of each amp 
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lie between 0 and 1 C ° nVemenCe ’ the ° ut P uts of the amplifiers are scaled to 

tation. The state vertoTtf b * deSCribed with state-space no- 
vector, y, represents the outputs of the amplifiers. The m!7 f , ampMeTS a * d the output 

ias currents to the amplifiers, I, determine the trajectory ofth* ° UCtances ’ T » and the input 
equation J y of the system according to the differential 

x = -t/ T + T y + / 

where (1) 

the til' L^tanttAhe ^ C °" !,ant of ,he “‘work, which U 
ground. otu comMt '' d between the input of each amplifier and 


The network seeks a local minimum of an energy function given hy 


B =-\y T Tv-v T i 

By proper selection of T and T c 

optimization problems onto the’network'^'^'^or' d ' Sign " i *° elI ' ec,ivel J' ™P various 
numnuzation problem where E represents the f ‘ , . ’“'“■“‘■'“■Md quadratic function 

given by Pr '“ nts the fuMt 'on to be minimized, the elements of T are 

d 2 E 


T- — - 

- L 'j 


dyidyj 


or, more succinctly, the T matrix may be expressed as 


r = 


and I is given by 


d 2 E 

dy 2 


T dE 


(4) 

(5) 

( 6 ) 


Substituting equation (6) into equation (1), we have 


- —x/t — 

-x/t 


dE 

dy 

dx dE 
dy dx 


(?) 

( 8 ) 


Th ■ V 9X ( 8 ) 

xninimizatiofaTgorit^ descent ^ ° f a gradient-descent 

matrix whose components (as can be seen from the sigmoTdf r & ^ Varying dia g°™l 

mtude as * moves away from the origin of the state ™ * f " nct ' 0n offi g ure 1) increase in mag- 
performs a gradient-search, only W minima can be found *' ^ netWOrk 
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TRAVELING SALESMAN PROBLEM 


The traveling salesman problem is a classic problem in combinatorial optimization which may 
be stated as follows: given n city locations, plan a tour for a salesman such that each city is visited 
exactly once, with the salesman ultimately returning to the starting city, in the minimum possible 
distance. This problem is interesting because it is both simple to state and, for a large number of 
cities, difficult to solve. In principal, the solution is simple: exhaustive search. However, the search 
space grows combinatorially with the number of cities and quickly becomes impractical to search 
for even the most powerful computers. The number of possible tours is (n — l)!/2. 


Hopfield and Tank have devised a way of mapping the traveling salesman problem tsp onto the 
neural network (ref. 1). For n cities, the state vector x and the output vector y are each composed 
of n X n elements which, although treated as vectors of dimension n 2 for purposes of state-space 
notation, are actually interpreted as n X n arrays. The energy function is designed to force the 
equilibrium output array of the network to the form of a permutation matrix, which has a single 1 
in each row and column and 0 elsewhere. The order of each city in the tour is then read off as the 
column containing the 1 in the row corresponding to that particular city. For example, the output 
array 


0 

0 

1 

0 


0 

0 

0 

1 


0 

1 

0 

0 


city 


would be interpreted as the city-sequence c-a-d-b. 

Each element of the output array y is confined to the range from 0 to 1 by virtue of the sigmoid 
function. By defining the energy function in a particular way, it is shown that the elements of the 
output array can be forced to values of 0 or 1 at equilibrium. That is, the output can be forced 
to move to a comer of the n-dimensional “hypercube” which constitutes the output space. For 
convenience, the notation t/j-i i s used to denote the element of the output array corresponding to 
the Jb-th city (row) in the i - th position (column). The energy function is given by 

E = A/2 X^X)^' 

t j l^j 

+ b/ 2 yyy y^ykj 

j i 


+ C/ 2 ( y y Uij no 


* o 


+ D/2 y^ y^ y dj^yjj ( yk t j+i Vkj-i) 

i k^i j 


( 9 ) 


where d^i represents the distance between the fc-th and Z-th cities (for notational convenience we 
treat the subscripts as modulo n, i.e., n + 1 —► 1, 0 — ► n), no (/ n) is a parameter used to provide 
an offset to the neutral positions of the amplifiers, and A, B, <7, and D are parameters selected by 
the experimenter. 

The energy equation (9) translates, according to equation (5), into a connection matrix given 
by 
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- ~A8 ik ( 1 - Sji) 

-BSjtil - 6 ik ) 

-C - Dd ik (S iij+1 + Sij-i) ( 10 > 

(where S tj = 1 if i = j and S {j = 0 otherwise) with external input currents 

Iij = Cn ° (11) 

B, and C provide the conYrtffits for the filing ^ WUh coefficients ^ 

coefficient A provides the inhibitory connection JYv !! ? “ genefa1 ' The term with 

neuron from being activated in each row at TW^’ than one 

function for the columns. The term with ropffi • f ^ ' Th< l term Wlth coeffici «nt B has the same 
to "»ke .he tow number of ^ T"" a * Mm ’ which "" ds 
term with coefficient D provides the informatin qtU ^ bnu ™ e< * ual to the number of cities. The 
the only term specific to each particular problem "a?” loCations of the cities a nd is thus 

permutation matrix, the latter term i» equal to the totTLrT.^ ne ‘'' 0 ' k *° * VaM 

(U) iM ° ^ (1) -> dS ** **>-« differential equation 

iij = - Xi il T - A Y,y»-B'£yk j 

i ?j k^i 

~ c ^Z Z yu - j 

Z (yk,j+i + Vk,j-i) ^ 12 ) 

and 

= X /2 (1 + tanh(*i,-/* 0 )) . 

for all land.]. The sigmoid function of equation (131 is intends i 

of - — — — ■ ^ X25 

or aiuh e er P i :;s r r 5 t : f it* r v r bta ^ - «-* - « 

distributed random noise of relative magnitude 10% to e^c^Yt ° ^ addmg uniforml y 

necessary to break symmetry, because otherwise the . & 6 vanable - The random noise is 

tours of identical length and thus does not convert c Y dis . tin S uish bet ween the 2n 

the initial state determines the final output state. § mCC ^ netW ° rk 1S a free -™nning system, 


Feedback Control of Input Current 

offset of the -'«i e pol!™ th^“„“ 
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and the parameters of the network and cannot be easily predicted. Hopfield and Tank apparently 
selected the value of no by trial and error for their particular example problem. It is now proposed 
that the network just described be modified to have feedback control of the value of n 0 , which is 
accomplished with feedback control of the input current. 

The feedback control is intended to force the total excitation level of the network to the proper 
value at equilibrium. At equilibrium, the scaled sum of the outputs of all the amplifiers should 
equal the number of cities, n. The feedback control law simply adjusts the value of no according 
to the difference between the sum of the outputs and the number of cities, as follows: 

* 0 = ~ K ( 14 ) 

where A" is a constant feedback gain. The exact initial value of no is not critical; it may as well be 
set to n or somewhat greater, perhaps 1.5n. 


SIMULATION RESULTS 

The simulation of the traveling salesman problem solution by Hopfield and Tank was duplicated 
as accurately as possible. With the exception of the time constant r, the parameters were set to the 
same values used by Hopfield and Tank. Hopfield and Tank made the statement (ref. 1) “Without 
loss of generality, r can be set to 1.” That statement is apparently incorrect, and may have led one 
group to conclude (ref. 2), “Our simulations indicate that Hopfield and Tank were very fortunate 
in the limited number of TSP simulations they attempted.” A more reasonable value for r is 10“ 4 . 
The parameters were thus 

A = B = 500, C = 200, D = 500 
*o = 0.02, r = 10~ 4 

In this evaluation, a simple first-order Euler integration scheme was used, with an integration time 
increment of At = 10~ 5 , which is one-tenth the time constant r. 

To establish a baseline, the traveling salesman problem was also solved by using the trivial 
nearest-city approach. One city was chosen as the starting point, and the “salesman” simply 
continued going to the nearest city which had not yet been visited until all cities had been visited. 
The initial city is arbitrary as far as the closed-path distance is concerned, but the choice of initial 
city affects the result of the nearest-city algorithm. Therefore, each city was tried as the initial city 
and the best result was recorded. The execution time of the complete algorithm was thus of order 
n 2 , which grows neither combinatorially nor exponentially with the number of cities. 

The network configuration parameters given above were used on five randomly located sets 
of 10 and 15 cities. For each set of cities, 20 different random initializations of the network were 
tried. The results are summarized in tables 1 and 2 for the 10-city and the 15-city problems, 
respectively. The tables show, for each randomly located set of cities, the number of trials resulting 
in valid solutions (permutation matrices), the number resulting in solutions as good as or better 
than the nearest-city solution, the normalized tour distance of the best solution (normalized with 
the nearest-city tour distance), and the normalized average tour distance for all the valid solutions. 

Plots of the best neural network solution of the 20 trials for each random city set are shown in 
figures 2 and 3 for the 10- city and the 15- city problems, respectively. For purposes of comparison, 
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the best nearest-city solution is shown to the left of each corresponding neural network solution. 
The individual plots are ordered according to the tour numbers in the tables. 

According to these results, the neural-network approach cannot be depended on to reliably 
provide even a valid solution of the traveling salesman problem: for the 10-city case, 78% of the 
trials resulted in valid solutions; for the 15-city case, 72% were valid. Of those valid solutions, 51% 
were better than the best nearest-city solution for the 10-city case and 28% were better for the 
15-city case. For all of the 10-city cases and all but one of the 15-city cases, the best of the 20 
neural-network solutions was better than the best nearest-city solution. However, the average of 
the valid solutions was slightly worse than the best nearest-city solution for all but one of the city 
sets. 


Of course, the network performance could possibly be improved by tuning the parameters 

more carefully, but that would be very time consuming and computationally intensive so it was not 
attempted. 


An attempt was made to solve randomly-generated 20-city traveling salesman problems, but the 
network configuration with the parameters given above was completely unsuccessful at converging 
to valid tours. No extensive effort was made to find a better set of parameters. A brief effort was 
made to incorporate slowly increasing amplifier gains, as was done by Hopfield and Tank for the 
30-city problem, but this was not successful. Thus a serious question remains as to how useful 
the neural network method is for the large-scale traveling salesman problem. Unfortunately, the 
simulation becomes so computationally intensive for the case with many cities that the potential 
payoff may not justify the development effort involved in retuning or reconfiguring the network. 
This could change if an actual analog-hardware network becomes available. 


CONCLUSIONS 


The use of the Hopfield neural network with continuous- valued neurons to solve optimization 
problems is equivalent to a gradient-descent algorithm which minimizes a quadratic cost function. 
Thus only local minima can be found. 

The method proposed by Hopfield and Tank for using the network to solve the traveling 
salesman problem has been tested by simulation. An error in one of the parameters reported in the 
Hopfield and Tank paper appears to be the source of convergence difficulties reported by several 
researchers. Apparently the network time constant should be approximately 1(T 4 rather than 1. 
Once that error is corrected, the network performs generally as claimed. 

A new method of feeding back the total excitation level of the network to control the input 
bias currents to the amplifiers has been tested and found to work very well. The method eliminates 
the need to use trial and error to set the input currents. 

Since there is a 2n redundancy in the solution of the traveling salesman problem (starting 
city and direction of tour is arbitrary) a partially random initialization of the neurons is required. 
Otherwise the network cannot break the symmetry and hence does not converge at all. When the 
parameters given by Hopfield and Tank are used, not all random initializations lead to a useful 
solution. In some cases, the network does not converge to a valid tour at all; in other cases, the 
network converges to a valid tour which is worse than the simple nearest-city solution. However, 
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if several different random initializations are tried, some are likely to result in a valid tour with 
a shorter tour distance than that resulting from the nearest-city solution. This was shown by 
simulation for the 10- and 15- city traveling salesman problem. 
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Figure 2: Right column: best neural network so- 
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